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The aim of this article is to estabUsh asymptotic distributions and consistency of subsamphng 
for spectral density and for magnitude of coherence for non-stationary, almost periodically cor- 
related time series. We show the asymptotic normality of the spectral density estimator and the 
limiting distribution of a magnitude of coherence statistic for all points from the bifrequency 
square. The theoretical results hold under a-mixing and moment conditions. 
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1. Introduction 

The analysis of the second order structure of time series is usually based on the charac- 
terization of the autocovariance function. One possibility is that the time series is not 
stationary, with a periodic or an almost periodic autocovariance function. The models 
with this structure were applied in many fields, including telecommunications [12, 23], 
meteorology [2], econometrics [24, 25] and many others (see the review in [28] or [13]). 
This class of non-stationary time series was introduced by [14]. Formally, we say that a 
second-order real- valued time series {Xt : f € Z} is periodically correlated (PC for short) 
if both the mean /u(t) = E{Xt) and the autocovariance function B{t,T) = coy{Xt,Xt+r) 
are periodic at t for every r G Z, with the same period T. A second-order real-valued 
time series {Xt : t € Z} is called almost periodically correlated (APC for short) if both 
the mean fi(t) and the autocovariance function B(t,T) are almost periodic function at t 
for every t S Z. The definition of almost periodic function that we use in this paper can 
be found in [4], page 45. It is easy to see that the class of APC time series contains the 
class of PC time series and the class of stationary time series. 

One of the main problems is how to detect this kind of non-stationary structure in the 
time series. This problem was considered in the time domain by Vecchia and Ballerini [30], 
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Dandawate and Giannakis [5], Deliay and Leskow [7], Synowiecki [29] and, recently, by 
Lcnart et al. [19]. Lenart et al. [19] present tests for PC structure based on the estimator 
of Fourier coefficient a(A, r) and tlie subsampling methodofogy. In the frequency domain, 
the problem of detecting periodicity was considered by Hurd and Gerr [16], Lund et al. 
[22], Broszkiewicz-Suwaj et al. [3], Lii and Rosenblatt [20] and Hurd and Miamee [17]. 
Hurd and Gerr [16] and Hurd and Miamee [17] present a graphical method for detecting 
stationarity and periodicity, where the testing statistics were approximated by a beta 
distribution. However, this method has not yet been justified for non-Gaussian white 
noise or dependent random variables. Broszkiewicz-Suwaj et al. [3] have used the moving 
block bootstrap to construct methods for detecting periodicity in time series. Still, the 
consistency of the bootstrap applied for their testing statistics remains an open problem. 
Lii and Rosenblatt [20] present an innovative algorithm for estimating the support of the 
spectral measure for Gaussian APC processes. The authors considered the case where 
the support of the spectral measure is concentrated on a finite number of parallel lines. 

In the next section, we recall the theoretical background and formulate the assump- 
tions which are used in the sections which follow. We consider general APC time series for 
which the support of the spectral measure can be concentrated on an infinite number of 
parallel lines. Section 3 presents the consistent estimator for the magnitude of coherence 
and the extension of the spectral density function to the bifrequency square (0,27t]^. In 
this section, we show the asymptotic normality of the normalized spectral density esti- 
mator, the asymptotic distribution of the normalized magnitude of the spectral density 
estimator and the coherence statistic for all points from the bifrequency square (0,27t]^. 
We give the exact forms for these distributions. It is shown that the asymptotic distri- 
bution of the normalized magnitude of the coherence statistic strongly depends on the 
support of the spectral measure. This distribution is not Gaussian for the points which 
do not belong to the support of the spectral measure. Recall that for the time series, the 
asymptotic normality of the spectral density estimator was shown for the stationary case 
in [31] under an a-mixing condition and in [27] for linear filters. For the PC case, the 
asymptotic normality was established in [17] for linear filters. Asymptotic distributions 
from Section 3 provide a possibility to establish consistency of the subsampling for the 
magnitude of spectral density and coherence, which is shown in Section 4. It should be 
emphasized that magnitude of spectral density and coherence are broadly used as fun- 
damental characteristics for telecommunication signals (see [11]). Section 5 presents a 
simulation study, where we show applications of our results. Following the ideas of Hurd 
and Gerr [16] and Hurd and Miamee [17], we present graphical methods for detecting pe- 
riodicity in autocovariance and give theoretical justifications for these methods. Finally, 
the asymptotic distribution and consistency of subsampling provide a possibility to con- 
struct asymptotically consistent confidence intervals for magnitude of spectral density 
and coherence. All proofs can be found in the Appendix. 

2. Definitions and assumptions 

We will be focusing on second-order inference for time series, therefore, for simplicity, we 
make the following assumption: 
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(Al) Assume that the real-valued time series {Xt :t€Z} is zero-mean. 

Moreover, we will consider non-stationary, almost periodically correlated time series; 
therefore, we formulate the next assumption: 

(A2) Assume that the time series {Xt : i G Z} is APC. 

In the APC case with = for any r e Z, the autocovariance function B{t,T) has 
the Fourier representation 

i3(t,r)~ ^ a(A,r)e'^*, (1) 

where a(A,T) are the Fourier coefficients of the form a(A, r) = lim„_j.oo Sj=i t)c~^'^^ 
and the set A,- = {A G [0, 2n) : a(A, r) ^ 0} is countable (see [4]). 

Define the set A ~ Urez^^- make the following assumption concerning the set 
A and the Fourier coefficients a(A,T). We need this assumption in order to establish 
asymptotic properties of the spectral density estimator: 

(A3) Assume that for any x G [0,27t), there exists a real-valued sequence {zr{xy\r& 
such that we have 



E 

A6A,\{2;} 



a(A,T)cosec 



A — a; 



<Zr{x) <00 (2) 



and Zt{x) — > for \t\ — > oo. 

Remark 2.1. By (A3), we have that X^agA which implies that 

i?(t,r)= ^ a(A,r)e'^*. (3) 

AeA^ 

If card(A) < oo, and we assume that \B{t, t)\ <pr uniformly at t and Pr ^ for |t| — >■ oo, 
then (A3) holds. Note that (2) implies that for any A € [0, 2n), we have that |a(A,T)| — >■ 
as |t| — > oo. 

To introduce the spectral theory for APC time series, we need the following assumption: 

(A4) Assume that the time series {Xt:t€ Z} is harmonizable (for the definition, see 
[21] or [32];. 

By assumptions (A2) and (A4), the spectral measure i?, defined on the bifrequency 
square (0,27r]^, has support contained in the set (see [6]) 

U {('^,'^)e (0,27r]2:w = jy-A}. 
|A|eA 

Moreover, the coefficients a(A, r) are the Fourier transforms of complex measures t\{-), 
that is, a(A,r) = " e'^'^rA(d^). The measure r\ can be identified with the restriction 
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of the spectral measure R to the hne u) = v — \, where |A| G A. We need the following 
assumption: 

(A5) Assume that the measure is absolutely continuous with respect to the Lebesgue 
measure. 

By the above assumptions, for any |A| G A, there exists a spectral density function 
gxi-) such that gx{iy) = 2k ^^=-00 T)e-''^^ (see [15] and [6]). 

Now, let us define the extension of the spectral density function P{-,-) to the bifre- 
quency square (0,27t]^ via 

Pi^^u) = I f P w c ^''"^ ^ (4) 

^ ' [ for (i^, cj) ^ 5. ^ ' 



Hence, 



-j 00 

= ^ E a(^-^,r)e-''^^ (5) 



27t 

r — — 00 



for any {i', lu) G (0, 27t]^, which follows from the fact that a(i^ — w, r) = for any — wj G 
[0, 2n) \ Ar and t G Z. If we assume that goiO for any ^ G (0, 2n], then for any point 
(z^, w) from the bifrequency square (0,27t]^, we define a magnitude of coherence via 

l^^^*"^' for cj = !.- A and |A| G A, 



for (zy,a;) ^ 5. 

Note that the magnitude of coherence is a real number from the interval [0,1], while 
the extension of the spectral density function is a complex number. 



3. Asymptotic distributions 

The estimator of P(i^, w) (based on a sample {Xi,X2, ■ ■ ■ ,Xn}) of the form 

n n 

^"(-'-)-^EEMe^"'V- (7) 

s=l t=l 

is generally not consistent in the mean square sense for APC time series. The exact form 
of the asymptotic variance of this estimator was calculated in [18] . 

To obtain a consistent estimator, we consider the following class of smoothed estimators 
of P{i',(jj) (see [31] for the stationary case): 

-. n n 

G„ (^, ^) - ^ E E {s - t)XsXtC-'-'c'"\ (8) 

s=l t=l 
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where H^^ (•) is a lag window function such that H^^ (r) = for |t| > L„, t G Z and L„ 
is a sequence of positive integers tending to infinity with n. Moreover, we assume that 
L„/n — > 0. If we assume that go{C) 7^ for any C G (0; 27t], then we define a magnitude of 
coherence statistic based on the estimator (8) via 

... x, \Gn{v,Uj)\ , , 



^J\Re{Gn{l^,^^))ReiGn{uJ,uJ))\ 



The foUowing considerations wih involve the general assumption that we have a sample 
{Xc„+i,Xc„+2,---,Xc„+d„} from time series {Xt:tGZ}, where {c„}„gz and {d„}„gz 
are arbitrary sequences of non- negative integers such that (i„ — ^ 00. This will help us to 
prove the consistency of the subsampling procedure to be discussed in Section 4. 

Given a sample {Xc„+i,Xc„+2, ■ • ■ ,^c„+(i„}, we define the estimators of P{i>,ui) and 
via 

Pn\^^^) = i^ E E ^.^*e--V*-, (10) 

^ Cji +dn Cji +C?n 

G^;^(^,c.) = — - E E i?L.„(s-OMe-'^V*- (11) 



s=c„ + lt=c„ + l 



and 



l7r/(-,-)l = , (12) 
^\Rc{G'n\v,v))Rc{G''/{uj,uj))\ 

Besides the fact that, in this work, we consider zero-mean time series, in the following 
remark, we define the estimator of the spectral density function in the case where the 
mean function is an almost periodic function such that /.i(t) ^ 0. 

Remark 3.1. Assume that the mean function ^{t) — E{Xt) for APC time series is 
an almost periodic function such that nit) = X]7er ^(7)^'^*' where 6(7) are the Fourier 
coefficients and the set F is known and finite. The natural estimator of the mean function 
^{t) (for c„ + 1 < t < c„ + d„) based on a sample {Xc„+i, Xc„+2, • ■ • , ^c„+d„} then takes 
the form jjin'^{t) = X^^er ^n'^il)^^^*' ^ where b'^'^{j) ~ ^ J^j'LI'^+i XjC~^''^ is an estimator 
of the Fourier coefficient 6(7) for any 7 G F. The more general natural estimator of the 
spectral density P(iy,uj) based on a sample {Xc„+i, Xc„+2, • ■ • , ^c„+d„} then takes the 
form 

^^'^^''^"'"'^ = 2^ ^ ^ i?L,„(s-i)(X,-A^-''(.))(X,-/i:;^'^(0)e-'-e'-*. (13) 

" s=c„+l t=c„ + l 



Similar modification in the PC case can be found in [17], Section 10.4. 
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In Theorem 3.1, we show the asymptotic covariance between normahzing estimators 
G'ii'^{vi,u:i) and G'^''^(z^i, wi) for {vi,uji), [vi.uji) € [0,27t)^. We need the following as- 
sumption concerning the lag window function Hl^{-). 

(B) Assume that for the lag window function Hl^{-), where Ln — > oo, Ln/n 0, there 
exists a real-valued function w{-) such that: 

(i) w{x) — for \x\ > 1 and w{-) is an even function and non-increasing on the 
interval [0, 1]; 

(ii) there exists a real number 6 G (0, 1] such that for any \x\ < 9, we have w{x) — 1; 

(iii) Hl^{t) ~ w{t / Ln) for any t ^"L and n > 1; 

(iv) w{-) is Lipschitz continuous on the interval [—1,1] with Euclidean metric, which 
means that there exists a real number W such that for any x,y G [—1, 1], we have 

\w{x) — w{y)\ < W\x — y\. 

For the convenience of the reader, before Theorem 3.1, we introduce the concept of 
a-mixing. 

Definition 3.1 ([8]). Let {Xt'.t CzTj} be a real-valued time series. The a-mixing se- 
quence a{-) which corresponds to the time series {Xt : i G Z} is defined as 

a(s)=sup sup \P{Ar\B) - P{A)P{B)\, 

t£l A<^Fx(-oo,t) 

where J-x{ti,t2) stands for the a-algebra generated by {X{t) :ti <t< ^2}- The time series 
{Xt : < G Z} is called a-mixing if a{s) — > as s 00. 

For any random variable X and positive constant p, we define the norm \\X\\p = 
iE\X\P)^^P. 

Theorem 3.1. Assume that (A1)-(A5) and (B) hold. If, additionally, there exist 6 > 0, 
A < 00 and K < 00 such that: 

(i) supt^z\\Xt\\e+3S < A; 

(ii) j:Zoik+i)Mky/^''-'^<K, 

then for any (1^1,^1), {1^2,^2) G (0,27t]^, we have the convergence 

lim -^cov(G^/(i.i,c.i),G^;''(z.2,^2)) 
= p{P{vi,V2)P{uJi,u:2) + ^(I'l, 27T- a;2)P(i'2, 27T- wi)), 
where p = ^^^w'^{x)Ax. 
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In Theorem 3.2, we show that the estimator (11) has an asymptoticahy normal distribu- 
tion. This result is crucial for establishing the asymptotic distribution for the magnitude 
of coherence statistic and proving the consistency of subsampling applied for magnitude 
of coherence and spectral density. 

Theorem 3.2. Assume that (Al)-(A5) and (B) hold. Additionally, assume that: 

(i) there exists 5 > such that sup^g^ ll-''^t|l6+35 < A < oo; 

(ii) L„ = 0(n'=) for some k € (0, (5/(4 + AS)); 

(iii) E^o('^ + l)'^a(A:)*/(''+2+*) <K<oo, where r is the even integer such that 



r > ma.xl 1 + 3(5/2, 



1-K 2k{1 + S) 



2k 'S-2k{1 + S) 



Then 




RciG'ii''{i^,u)) 
Im(G$;''*(i/,c^)) 



Rc{P{iy,Lu)) 
Im(P(z^,cj)) 



■AA2(0,E(i.,w)), 



(14) 



where Ts{i>,uj) = [CTy],;j=i,2 7 

an = i(5o(j^).9o(w) + \P{i^,2n - lo)\^ +Rc{P{iy,2n - i^)P{2n - io,io)) 

+ [Rc(P(;.,c.))]2-[Im(P(;.,c.))]2), 
^712 = a2i = -[Re{P{iy,Lu))]^[lm{P{iy,Lu))]^ - i Im(P(zy, 27T- :^)P{2n - io,io)), (15) 
= ^igQ{iy)go{Lo) + \P{u,2n- lo)\'^ - Rc{P{iy,2n- iy)P{2n- lj,lo)) 
-[Re(P(z.,c.))]2 + [Im(P(z.,c.))]2). 

Recall that in the stationary case, for the majority of spectral windows, the optimal 
Ln (in the mean square sense) for the estimator G„(z/, w) is of order n^^^ (sec [27], pages 
462-463, or [26], page 86). Note that condition (ii) of Theorem 3.2 includes the case 
Ln = 0(ni/5) for (5 > 4. 

The following corollary is a natural generalization of the previous theorem to the 
multidimensional case. We need this result to establish the asymptotic distribution for 
the magnitude of coherence statistic. 

Corollary 3.1. Let {Xf : t G Z} be a time series such that all the assumptions of Theorem 
3.2 hold. We then have the convergence 




Re{G'i;\v,u)) 
Re(G;^'^(z/,;.)) 
Re(G^''^(w,^)) 
Im(G^'''(^.,w)) 





-Rc(P(z/,w))- 






9f){v) 


) 




50 (w) 






Llm(P(z.,c^))J 





.AA4(0,*(i^,c.)), (16) 
where the covariance matrix '^(ujUj) can be obtained by Theorem 3.1. 
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Remark 3.2. Note that in the special case where i/ = w, we have rank(S(z/, v)) = 1 and 
rank('I'(i/, i^)) = 3, which follow from the fact that lm{G'^'^ (y , v)) = 0. 

Let us establish the asymptotic distribution of the normalized estimator w)| 
(under all the assumptions of Theorem 3.2). Note that if P{v,lij) = 0, then by Theorem 
3.2 and the continuous mapping theorem, we get 



';^|G$;'>,a.)| A£(Z), (17) 



where Z := ^/Sf+S^ and the random vector {81,82) has a two-dimensional nor- 
mal distribution with mean zero and a covariance matrix equal to E(j/, w). If we as- 
sume that trace(E(i/, w)) > 0, then the distribution of a random variable Z is con- 
tinuous. Now, assume that P{v,La) 7^ 0. Applying the delta method for the conver- 
gence (14) and the function f{x,y) = i/jr^+y^ that is differentiable at the point 
(a;o,yo) = (R.e(P(i/,a;)),Im(P(i/,w))), we get 



^(|G^'''(j.,w)| - |P(z.,w)|) A AAi(0,DiI](i.,c.)DT), (18) 



where 



Di= ip/ ., (Re(P(^,^)),Im(P(z.,a.))) (19) 

and M'^ is the transpose of the matrix M. 

Now, let us establish the asymptotic distribution of a normalized statistic |7^'''(:/, w)| 
for V ^bj (in the case v = uj, we have |7^''^(i^, w)| = 1). To do this, we assume that 
9vi{y)gniyj) 7^ 0. In the first case, take {y^iS) G (0,27t]^ such that P(y,bj) = 0. By Theo- 
rem 3.2, the continuous mapping theorem, consistency of the estimators G'ji'^iy^v) and 
G'J^''^(a;,a;) and Slutsky's lemma, we then have 



y^|Re(Gf,'''(z.,i.))Re(Gf,''^(u;,c.))| 



(20) 



If the trace(E(i/, w)) > 0, then the limiting distribution in (20) is continuous. As a final 
consideration, assume that P{i',uj) ^0. In this case, we use the delta method to show 
the asymptotic normality of the normalized estimator |7^'''(i/, a;)|. In doing this, we use 
convergence (16) and the function f{x,y,z,t) — ^^^^^ is differentiable at a point 
(xo,j/o,-zo,io) = (Re(P(z^,w)),5o(i'),ffo('^),Im(P(zy,a;))). Applying the delta method, we 
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conclude that 



where 



^ / Re(P(^,^)) 1 1 Im(P(^,c.)) \ 

Remark 3.3. By elementary calculation, the assumption that tracc(I](j/, w)) > is 
equivalent to go (1^)50 (w) + | P(i/, 27t — a;)^ > 0, which is true if we assume that (?o(C) > 
for any ^ € (0,27t]. Moreover, DiS(i/, cj)D-f > if we assume that det(I](z/, cj)) 7^ 0, and 
D2*(i', w)DJ > if we assume that det(^(:^, u:)) ^ 0. 

In the corollaries which follow, we summarize considerations concerning the asymptotic 
distributions of normahzed estimators |G^'''(i^, a;)| and |7^''^(i/, w)|. 

Corollary 3.2. Let {Xt : t G Z} he a time series such that all the assumptions of Theorem 
3.2 hold and that go{£,) ^0 for any ^ e (0,27t]. Take any {v^lo) e (0,27t]^. For the case 
where P(y,uj) 7^ 0, we require that det(S(i/, w)) ^0, where matrix S(i',cj) is given by 
Theorem 3.2. Under these assumptions, we have the convergence 



jP(v,u) 



U{Z) zfP{u,uj) = 0, 

\M(0,DiS(i.,w)DT) ifP{,y,uj)^0, 



(22) 



where C{Z) and Di are given by (17) and (19), respectively. Moreover, the distribution 
jPii^,^) ^jP Jqj. short) is continuous. 

Corollary 3.3. Suppose that all the assumptions of Theorem 3.2 hold and that (70(C) 7^ 
for any ^ £ (0,27t]. Take any (y,ui) £ (0,27t]^ such that v ^lo. For the case where 
P{v,uj) 7^0, we require that dct{'^{i>,uj)) 7^0, where the matrix 'i!(iy,Lu) is given by (16). 
Then 



-^(|7;i'>,a;)|-|7(i^,..)|) 

, (23) 

d j-y{y.u,) _ I C{Z/^gQ{v)go{uj)) if P{v,uj)^Q, 

\AAi(0,D2*(i^,L^)DT) ifP{v,uj)^Q, 



where C{Z / go{i')go{uj)) and D2 are given by (20) and (21), respectively. Moreover, the 
distribution J'''^"'") (J'^ for short) is continuous. 
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Note that we cannot use the asymptotic distributions from Corollaries 3.2 and 3.3 
in practice if we do not know that P{iy,Lu) = 0. Even if we know the period T for PC 
time series, the value of |-P(i^, ly ~ X)\ for A £ {2kn/T: fc = 0, 1, . . . , T — 1} can be equal to 
zero. For example, consider the model (29) with period r= 12. After calculations (we 
omit overly long formulae), goif) = (235 + 72cos(i^))/(167t), gn/eii^) ^ 0, Sn/ai'^) ^ 0, 
9n/2{^) = 92n/3{'^) = 3^ and, crucially for this example, g^n/aW) = 0, g-nW) = for 
V g (0,27t]. Therefore, we refer to the subsampling methodology, which does not require 
information about P{i',ljj). 

4. Subsampling procedure and consistency 

Let us introduce the subsampling procedure. Some of the notation is adopted from [26]. 
By L^(j and t,, we denote the subsampling estimators of distribution functions of 
^n/Ln{\Gn{v,uj)\ - |P(i^,a;)|) and ^n/ Ln{\%{v,uj)\ - |7(:^, i:j)|), respectively. For any 
point X G M, we define those estimators as 

n-b+l 

= — r-T E nVblLb{\&-'\vM\-\Gn{i^.^)\)<x}, (24) 
= — r-T E HVhlL,{W-''\v,u^)\-\U^,u^)\)<x}, (25) 

where 

t+b-lt+b-l 

^ E E H,,{n-j^X,,X,^e-^'^^^^-^^, 

jl=t j2=t 

yj I Re{Gi-^ \v, v)) Jie{Gi-^'\Lo, 

and l{i?} is an indicator function of the event B. Denote by J^{x) and J'^{x) the 
distribution functions of and J'* , respectively. For any a £ (0,1) let c^b(l — a) and 
f,(l ~ C() be quantiles of the nominal level 1 — a from subsampling distributions (24) 
and (25), respectively. The following theorems concerning consistency of subsampling 
then hold. 

Theorem 4.1. Under all assumptions of Corollary 3.2: 

(i) L^^f^ix) A- J^{x) for any x £ R; 

(ii) sup^gR \L'^,b{x) - J^{x)\ 4 0; 



|7*-''''(^,^)|- 
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(iii) the subsampling confidence intervals for \P{h',io)\ are consistent, which means 
that 

P{^^i\Gniiy,Lo)\ - \Pii^,i^)\) < - a)) ^ 1 - a, (26) 

where b — b{n) — > oo and b/n — > 0. 

Theorem 4.2. Under all the assumptions of Corollary 3.3: 

(i) Ll ^^(x) 4 J-iix) for any x e M; 

(ii) sn^,^^\Ll,{x)~J'^{x)\^0; 

(iii) the subsampling confidence intervals for |7(zy, a;)| are consistent, which means that 

P{V^n{\ln{^,^)\ - l7(^,w)|) < cl,{l - a)) ^ 1 - a, (27) 
where b — b{n) — > oo and b/n — > 0. 

5. Simulation study 

In this section, we show possible apphcations of the results from Sections 3 and 4. In 
Section 5.1, we present graphical methods for detecting the presence of periodic autocor- 
relation. We consider simulated data sets. In Section 5.2, we calculate confidence intervals 
for the magnitude of a spectral density using subsampling and asymptotic distributions. 

5.1. Graphical methods for detecting periodicity 

Take any point [v, w) from the bifrequency square (0, 27t]^ such that v ^oj. Let us consider 
the null hypothesis i?o : |P(z^, a;)| = and the alternative hypothesis Hi : |P(i/, a;)| ^ 0. 
If we assume that g(){i/)go{uj) ^ 0, then the above hypotheses _ffo a-nd Pl\ are equiv- 
alent to HQ:\^{y,ij:')\ =0 and iJi : |7(i^, w)| 7^6, respectively. Under the assumptions 
of Theorems 4.1 and 4.2, we can use the statistics T^(i/, w) = \J nj Lr\Gn{v,uj)\ and 
X1(y,LS) = \J n I LnYlniy ,u))\, and critical values from the subsampling distributions (24) 
and (25) for the above testing problems. Under Hq, the rejection probability tends to 
a and under this probability tends to one, which means that the both tests are 
asymptotically consistent. 

Additionally, by Corollary 3.2, we use the statistics 

for the above testing problem, where a^(y,uj) and (T^(i', w) are estimators of the asymp- 
totic variances of \J n/ Ln Re(G„ [v, w)) and ri/ Ln Im(G'„(z^, w)), respectively (see The- 
orem 3.1), obtained by replacing the unknown spectral densities by their estimates (see 
formula (8)). Under hypothesis Hq, the matrix I](i', w) from Theorem 3.2 has non-zero 
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(a) (b) (c) (d) (e) 

Figure 1. Graphical methods for detecting the presence of periodicity of covariance for samples 
from the MA(2) model: Xt — 2et-2 + et-i +et, with Normal(0, l)-distributed innovations: (a) 
time series; (b) tests for \P(us,iJt)\ based on the statistic T^{vs,ijJs) and subsampling; (c) tests 
for \P{us,LOt)\ based on the statistic T^{uB,LOt) and central chi-square distribution with two 
degrees of freedom; (d) tests for |7(!/s,a;t)| based on the statistic TZivs,u}t) and subsampling; 
(e) tests for |7(!/s,i^t)| based on the statistic presented in [16], formula (11), page 342, and the 
beta distribution. 

elements only on the main diagonal. Therefore, under Hq, the test statistic T^(;/, oj) has, 
asymptotically, a chi-square distribution with two degrees of freedom. 

For different points (i^, from the bifrequency square (0,27t]^, we may consider the 
above testing problems. If we reject hypothesis Hq for many points for which ui = v — X, 
where A is some constant different from zero, then it can be suspected that the time 
series {Xt :t g Z} is not stationary (see [16], Figure 1). 

We calculate values of the statistic T^{i/,uj) for data for each point from the set 
{{us,u;t) = (27Ts/120,27t</120),l< s < 120,1 < t< 120, sj^t} C (0,27t]2 and we compare 
these values with the critical values c^^(l — a). If the value of T^(:/, cj) exceeds c^{,(l — a), 
then we reject hypothesis Hq and put a black mark at the point {v, uj) on the bifrequency 
square. The same steps are repeated using statistics TJ^(;/,aj), T^(z^,a;) and appropriate 
critical values from subsampling and chi-square distributions. We fix n = 720, i„ = 
[ni/5] =4^ ^= =80^ [61/5] = 2 and a = 99%. We put i?i,„(r) = 1{|t| < L„}, 

where 1{-B} is an indicator function of the event B. We compare our methods with the 
method presented in [16] and [17]. We put M = 25 into [16], formula (11). Note that 
using multiple testing procedures for various points seems to be difficult for graphical 
methods presented in Figures l(b)-(e) and 2(b)-(e) because the number of different 
tests on each figure is 14400 and this is bigger than the length of the sample, which is 
n = 720. If we use multiple testing procedures and we calculate the quantiles from the 
subsampling distribution, then the justified significant level should not be too small in 
comparison with the sample size. Some intuitive adjustment for the significant level in 
the graphical method presented in Figures 1(e) and 2(e) for the PC case was made in 
[17]. The theoretical results which can help in multiple testing procedures in connection 
with subsampling approximation can be found in [1], where the question of how well 
the subsampling distribution approximates the tail of an unknown distribution that we 
approximate was considered. 

Figure 1 presents the stationary case. All methods for this case fail to show the evi- 
dence of periodic correlation. Figure 2 presents methods for the sample from the periodic 
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moving average model of order one with period equal to T = 4. All methods for this 
case clearly reveal the presence of periodic correlation with appropriate length of period 
r = 4. In summary, all methods can successfully distinguish the stationary case from the 
PC case. Moreover, there is no clear difference in these examples between the efficiency 
of the above graphical methods based on subsampling, the central chi-squarc distribution 
with two degrees of freedom and the beta distribution. 

We chose the parameters L„ and h to satisfy the assumptions in Theorems 4.1 and 
4.2. Note that in [26], pages 190-191, the problem of choosing b in practice in special 
cases was considered. It was found that the choice of b is, in practice, a delicate issue, 
like the choice of the bandwidth L„ in nonparametric spectral density estimation. It was 
also shown in [19] in simulations that the type I error and power of the test based on 
subsampling approximation for significance of the value |a(A,T)| strongly depends on 
the choice of the parameter h. It is likely that a similar problem occurs in the graphical 
methods presented in this work, where the choice of the parameters L„ and & is a open 
problem. 



5.2. Confidence intervals 



From Theorem 4.1, we can obtain a two-sided equal-tailed consistent confidence interval 
for the parameter a;)| in the form 

{\G^{v,u)\ [l - / \Gn{^A\ - <t (f ) /V^) , (28) 

where a £ (0,1) is a nominal level. A similar confidence interval can be obtained for 
coherence using Theorem 4.2. Consider the periodic moving average model of order one 
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(b) 



(c) 



(d) 



(e) 



Figure 2. Graphical methods for detecting the presence of periodicity of covariance for sam- 
ples from the PMA(l) model: Xt = (2 + sin(27tt/4))^et_i + et, with period T = 4 and Nor- 
mal(0,l)-distributed innovations et: (a) time series; (b) tests for \P{ys^bJit)\ based on the statis- 
tic T^(i/s,i^s) and subsampling; (c) tests for |P(iys,cJt)| based on the statistic T^(j/s,a;t) and 
central chi-square distribution with two degrees of freedom; (d) tests for |7(!/s,t<Jt)| beised on the 
statistic T^(i/s,a;t) and subsampling; (e) tests for |7(i/s,aji)| based on the statistic presented in 
[16], formula (11), page 342, and the beta distribution. 
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with period equal to T, 

Xt = e{t-l)et-i+eu (29) 

where 9(t) = (2 + sin(27tt/T))^ and tt is a Gaussian white noise with mean zero and 
variance equal to one. The aim of this section is to calculate confidence intervals for 
for time series of the form (29). 

Figure 3 presents 95% confidence intervals (28) for \P{y,v - A)|, T = 4, A e A = 
{0,7t/2,7T,|7t} and for v& {2kn/ 120 : k = 1, 2, . . . , 120}. We put L„ = [n^/^], [3y/n] 
and n = 500. Wc also present 95% confidence intervals based on the asymptotic distri- 
bution (see the formula in Corollary 3.2) by replacing unknown values of spectral 
densities in the asymptotic distribution by their estimates using (8). The confidence 
interval for g\{v) based on the asymptotic distribution has spikes on the interval 
(0, 27t] being considered. It follows from the fact that asymptotic variance in the limit- 
ing distribution depends (for fixed A) on a value P{—v,v— A) that is non-zero for 
the considered v e {2fc7t/120 : fc = 1, 2, . . . , 120} only for the points v e {n±x/2 : x G A}. 
This can also be observed for the stationary case, where the asymptotic variance of the 
normalized spectral density estimator on the main diagonal, expressed as a function of 

has a discontinuity at points VQ = n and vq = 2n (sec [27] and [31]). Note, that the 
distribution can be used to construct a confidence interval for |P(i^, w)| under ad- 
ditional information concerning parameter Pii/^uj). Therefore, subsampling seems to be 
more useful in practice when there is no rule to obtain the parameter b in our testing 
problem. 

6. Conclusions and open problems 

In this work, we give the exact forms of the asymptotic distributions for normalized 
spectral density and magnitude of coherence statistics and wc prove the consistency of 
subsampling applied for magnitude of spectral density and coherence. This research was 
done for a-mixing zero-mean APC time series with the support of the spectral measure 
concentrated on a countable set of parallel lines. By the consistency of subsampling, we 
construct asymptotically consistent confidence intervals for magnitude of spectral density 
and coherence. Importantly, this confidence intervals does not depend on the support 
of the spectral measure, unlike confidence intervals based on asymptotic distributions. 
Graphical methods for detecting the presence of periodic autocovariance were presented 
and their theoretical properties explored. One of the main problems is the choice of the 
parameter b in graphical methods, as presented in Section 5. 

The next problem connected with applications is the estimation of spectral density and 
coherence for non-zero-mean time series. Note that the well-known differencing operation, 
popular in time series analysis, is useful when the mean function is a constant or a periodic 
function with known period. Generally, if we assume that the mean function is almost 
periodic, then we cannot use the differencing operation, even if we known the set T 
(see Remark 3.1), in the Fourier representation of the mean function. To cope with this 
problem, we can consider spectral density estimators for non-zero-mean time scries of the 
form (13). This, and other open problems, are currently being researched by the author. 
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Figure 3. Confidence internals for \P{v,v — X)\ for A G A = {0, 7t/2, 7t, |7r} and 
for V G {2fc7t/120:fc = 1, 2, . . . , 120}. Solid line: theoretical \P{v,v - A)|; dashed 
line: 95% asymptotic confidence interval (based on distribution from Corol- 

lary 3.3) for sample size n = 500; light shading: 95% subsampling confidence inter- 
val (28). (a) The case A = 0, go{v) = \P{v, i^)\ = (59 + 18cos(i/))/47t; (b) the case 
A = \<]„/2M\ = IPd^^f - 7t/2)l = >/2(751 + 10cos(i/) - lOsin(i^) -sin(2i/))/7t; (c) 



f, IgnMi^)] = \Piiy,u - 7t/2)l 
the case A = 7t 

\g(,3/2)ni'^)\=\Pi'^,l' 



\gn{r^)\ = \Pi,y,v 

3 



7t)| = A/625 + 4sin^(!^)/47r; (d) the case A = fn, 



= v/2,/51 -I- 10cos(i/) + 10sin(!/) +sin(2i^)/T 



Appendix 

To begin, wc formulate a few auxiliary lemmas whieh are crucial for proving the theorems. 



Lemma A.l. Let {Xt'.t £1} he real-valued time series with corresponding a-mixing 

sequence a{-). Assume that there exist real numbers S > and A < oo such that 

sup(g2 ll^i||2-i-5 £ A. For any A € [0,27t), j G Z and r G Z, we then have the following 
estimates: 

(i) r)|<8AV/(2+^)(|r|); 
(ii) |a(A,r)| <8A2a^/(2+^)(|r|). 

Proof. The proof of (i) is elementary and is based on [8], Theorem 3, page 9. The proof 

of (ii) follows from (i) by noting that a(A,T) = lim„_j.oo "-"^ -^(^i for any 

A G [0, 2n) and r G Z. □ 
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Lemma A. 2 (Conclusion from [8], Theorem 2, page 26). Let {Xt:t G Z} be a 

zero-mean time series. Assume that there exist real numbers I > 2 and 5 > and an even 
integer r>l~2 such that sup^gz ||Xt|j/+5 < oo and X)fc!Li k^a^^'^^'^^'^^^k) < oo. There 
then exists a constant Ka i < oo (which depends only on the sequence a{-) and constant 
I ) such that for any a S Z and <? G N, we have the estimate 



a+g 
t=a+l 



< {K^,i max{Q{l,d, a, g), [Q{2, S, a, ff)]'/'})^/', (30) 



ii;/iereQ(Z,5,a,.g) = ES+ill^:'" 



Lemma A. 3 (Multidimensional generalization of the CLT of [10]). Let {Yn.t = 
(?/«,*. ij 2/n,t,2, • ■ • , yn,t,d) G ^ 1 < i < bc a triangular array of zero-mean real-valued 
random vectors, where {a„}„gN is a sequence of positive integers tending to infinity. 
Define 

Assume that: 

(i) there exists a constant 5 > such that 

sup{||2/„^t^fc||2+5 > 1, 1 < i < On, 1 < fc < rf} < A < oo; 

(ii) lim„^oo Var(S'„) = E; 

(ill) there exists a sequence of positive integers {hn\nen such that hn = 0{a'^) for 
some K G [0, ttjj), md a sequence {<;(fc)}fc>o such that an{k) < <;{k — hn) for all 



4+45 

k > hn and 



j2k\iky/^^+'UK<oo 



k=l 

for some r > 5-,^ 2b(T+(5) ' '^^^'^^ Q^ri(') is a mixing sequence for a triangular array 
{Yn^t : 1 < i < On} defined for any n>2 and ft, = 1, 2, . . . , a„ — 1 as 

a„(/i)= sup sup \P{Ar\B)- P{A)P{B)\. 

l<i<a„-h AeA„A 

An,t stands for the a-algebra generated by {K„^„ - ^ l£u <t} and Bn.t stands for 
the G -algebra generated by {Yn^u :t<u< an}. 

Then 5„ ^7Vd(0,I]). 

Proof. The proof is based on the same steps as that of the CLT of [10], and the Cramer- 
Wold device. □ 
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Lemma A. 4. Let {Xt:t£ Z} he a zero-mean and a-mixing time series. Assume that 
there exists a real number (5 > such that: 

(i) suptg2;ll^t||6+35 < A<oo; 

(ii) Er=o(^ + l)'«(fc)*/''+*^ <-f^<oo• 
^br any sequences {c„}„gz (md {(i„}„gz of integers where dn > 0, we then have 

Cn-\-dn Cn+dji C^+d^ C„+d„ 

- EiXsXu)E{XtX,) - EiXsX,)EiXtX.,)\ < Cd,,, 
where the constant C depends only on K and A. 

Proof. This proof is based on a similar technique as in the proof of [18], Theorem 4.1, 
and is therefore omitted. □ 

Lemma A. 5. Suppose that assumptions (A1)-(A5) hold. Using the notation from Sec- 
tion 3, for any {v,uj) G (0,27t]^, we have 



hm E[P^^''{iy,io)]=P{iy,uj). 

n~>oo 

Proof. Take any (u^uj) € (0, 27t]^ and note that {j r = s — t) 

E[P,r'{>^,u;)] = ^ ^ ^ £;(A,AOe-'(— )*e-"'(^-*) 



2ndn 

J — C„+l T — Cn + l—j 

c„+d„ c„+d„-j 

c„+d„ c„+d„~j 
j=c„+l r=c„ + l-j 



Cn+dn Cn+dn—j 

2ndn 

j=Cn + l r=c„ + l-j XeA^\{}y-uj} 



2n ^ \ d„ 

\T\<d„ 
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+ ^ E E E 



Denote the first and second terms of the last equahty by ei_„ and e2,n , respectively. Note 
that ei_„ is a Cesaro mean for the sequence X]|r|<d„ — ^,t)c^^'^'^ . Hence, ei^„ goes to 
P(i/,aj). By the estimate | X]j=p^~'^"'l — I cosec(x/2)|, where p <q, x^O modulo 2n, we 
have 



£2. 



c„+d„ (i„-l c„+t^„-T^ 



E E +E E E ^ 



^j(A-(iy-w))i^-ii/T 

^r=-(i„ + l j=c„ + l-r r=l j=c„ + l / AeA^\{i/-Lj} 



27t(i„ 

E E l«(^'^)cosec((A-(j.-c^))/2)|<-i- 



" T = -d„ + l AeA^\{i/-w} " T=-d„ + l 

which means that 62. „ — > (by (A3)). This completes the proof. □ 

Lemma A. 6. Suppose that (A1)-(A5) and (B) hold. Additionally, assume that there 
exist S > 0, A < 00 and K < 00 such that: 

(i) SUPtg2;||Xt||6+35 < A; 

(ii) EZoik + i)MkY/^'+'^<K. 
Using the notation from Section 3, for any G (0,27t]^ and any a G we then have 



^ E i?(^n+aA.,+,)i7,.,Jri)2e^"'(^^+'')e'-(-=+'^) 



1 

w{x)'^ dxP{i^,uj) + e„(z^, w), 

-1 

where |e„(i^, a;)| < e„(i', w) — > and e„(i', w) lioes not depend on a. 

Proof. Take any (i', w) G (0,27t]^ and note that using the same steps as in the proof of 
Lemma A. 5, we get 



2^ E E i?(^..+a^..+a)i/L.„(Ti)2e-''(^^+'')e'"(-^+'^) 



Tl= — Ld„ T2 = — Ld„ 

^ E E HlJj-a)a{.-u;,r)e-^^^ 

a+Ld„ a+Ld„-j 

+ ^ E E E i?L„0--«)«(A,r)eH-(-)be 
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E E 

|T|<2Ld„i=-Ld„ 



a{v — uj, T)e 



E E 

|r|<2L<i„i=Ld^-|T| 



X a{i' — w, T)e~ 



EE E ^ 

T=l j=a-La„ \eAr\{iy-Lj} 



2/ J -a 



a+Ld 



^ Y. Y. E 

: Mo(n) - Mi(n) +U2(n) +U3{n), 



2I 3~a 



a(A,r)c' 



i(A-(iy-w))jg-ii/T 



where uo(n), U2{n) and 1*3(71) arc the first, second, third and fourth terms, respec- 

tively, of the last equation. It it easy to see that uo(n) j_i uP{x) dxP{v^ to). Therefore, 
to prove the theorem, it is sufficient to show that iti(n) — > 0, U2{n) — > and 1*3(71) — )■ 0. 
By Lemma A.l(ii), for the term 7ti(n), we have 



E ^8AV/(^+^)(|r|)<?^^0. 



For the term 1/2(71), we have 



\u2(n)\ 



^E E E 7.^(^)a(A,r)en^-(— ))(^+'^)e-'- 



^ r— 1 



< 



j=-Ld„ XeAr\{i^-u}} 



2nLH 



■E E I E + E l-^(^)e'(-'-»(^-)a(A,r)c 



2-Ld„ 



I^d„-T 



E E E 



2/ ^\ i(A-(,.-cu))0+a) 



a(A, r)e 



< 



■E E 



■E E 



E 



2f ^^pi(A-(i.-a;))i 
id 



|a(A,r)| 



=1 AeA^Xfiz-tj} 



/i(«) 

J=0 



|a(A,r)| 



/2(") 
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1 



E E 



Ld„ -r 

E 

j=-Ld„ 



2f ^ ]ei(A-(!--c^))j 



|a(A,r)|. 



/3(n) 



Now, using the property | X]j=p Cje'-''^| < Cp\ cosec(a;/2)|, which is true for any x^O mod- 
ulo 2n and Cp > Cp+i > ■ ■ ■>Cq (see [9], Exercise 1.2, page 10) for the terms fi{n), f2{n), 
fsi^ri)^ we obtain the estimate 

\u2{n)\ <^T. E |a(A,r)||cosec((A- (z.-.;))/2)| 

r=l AeA^\{iy-Lj} 
2id 



27tL, 



^ E E KA,r)||cosec((A-(z.-^))/2)| 



< — — z-riiy - w) ^ 0. 

7T/,j ' 



" r — 1 

Using the same arguments, we get that u-^in) — > 0. This completes the proof. 

Proof of Theorem 3.1. Using simple decomposition, we have 
(27r)2d„ 



□ 



cov(G,'=;^(i.i,c.i),G:^''^(i.2,^2)) 



C-n +C?n Cn,+d„ C^+rfj^ C„+rf„ 



^ E E E E cov(X,X,,X,X.)i7^,j5-07/L.Ji/-^) 



- i ( Zv* 1 s — LJ 1 i — z.'2 + 2 ^ ) 



Cn -\-drL Cn--\-dn C„+rfn, Cn,+d„ 

7— E E E E (cov(X,Xt,X„X„)-S(X,X„)£;(XtX„) 



S — Cti+1 i — Cjn +1 u — Cn-\-l v — Cn-\-l 



-E{XsX,)E{XtXu)) 

+ E E E E E{xME{Xtx,)HL,ss-t) 



dnLd. 
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= si(n) + S2(n)+S3(«), 

where si(fT.), S2{n), s^{n) are the first, second and the third term, respectively, of the 
last equation. To prove the theorem, it is sufficient to show that si{n) 0, S2{n) — >■ 
{2'n)'^P{vi,i'2)P{uJi,uj2), S3.{n) — >■ (27t)^P(i^i, 27T — wi)P(zy2, 27T — ^2) as 71 00. Note that 
by the estimate 



{n)\<j^ 11 11 \coY{XsXuXM-E{XsXu)E{XtX,) 

E{XsX,)E{XtX^)\ 



and Lemma A. 4, we get that si{n) — )■ 0. Considering the term S2(n), we get (t = ji^ 

C„+C?n Cn-^dji C„+rfri C,i+rfn, 

S2{n)^—— E E E E EiXsXu)EiX,X.) 



sir S S - S E E 

E E - E E -E E 

j2=Cn + l r2 = — Ld„ r2=— L„ j2=c„ + l •r2 = li2=c„+d„ — T2 + 1/ 

X E{X,,+r,X,,+^,)E{X,,X,,)HL,^ {ri)HL,^ (^^)e-i(-i0i+n)-m--.02+.2)+^2.2) 



where 



'^°^''^^dj:7 51 E E E 
^iH = t4- e e e e 



1^21"! T2 



+ E E E E fnj2r,r,, 

" jl=C„ + l Ti=-La„ T2 = l j2=C„+d„-T2 + l 
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'^'^'"^"d^LZ ^ ^ ^ ^ '^JU2rir. 

" i2=c„ + l T2 = -La„ Ti = l ji=c„+d„-ri+l 
'^^^'^^^dj^ H H 5Z IZ 'PjU^rir. 



^ L„ c„+d^ — 1 c„ — r2 

"^1 — 1 il — Cji +rfri — Tl + l T2 — — -i/n j2 — *^Ti + l 

+ dj:rT. E E E ^nnr.r. 

^ Ti — 1 Ji — c„ — ri + l T2 — 1 J2 — — r2 + l 

We show that the terms di{n),d2{n),d3{n) tend to zero, which means that S2{n) has 
the same hmit as do{Ti). We start with the term di{n). By Lemma A.l(i), we have 
\^j^hr^r,\ < MA^a'/(^+'H\n ~ h\)a^/^^+^H\ji - J2 ~ (ti - Ta)!), which means that 

MiWi^l^ E E E E 

xa*/(2+^)(b-i-.?2-(ri-T2)|) 

" jl=C„ +l Ti=-Ld„ T2 = l j2=C„+d„-T2+l 

xa^/(2+^)(|ji-j2-(ri-T2)|) 



/c=-d„ + l Ti=-Ld T2=-Ld„ / 



64A4 ^ ''"-^ 



^7T^ E i.„«^/^^+')(|fc|)(2L,„ + l)2K 
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+ ^<i„a*'/(2+*-)(|fc|)(2X,„ + i)2xJ 

< {2Ld^ + l)^8K^ asn^cx). 

Using the same steps, we have that the terms d2(n) and ^3(71) tend to zero. For do(n), 
we get 

Jl=C„ + l J2=C„ + 1 

X iyi^Jri)2e-'(''i(^'i+^i)-''^(^i+^^)) 



jl=C„ + l j2=C„ + l 



ii'2 (i2+-r2)) 



-ii;(X,,+.,X,,+.,)e'^^(^'^+-^») 
X iJi,jTi)2e-'''i(^'i+^i) 

c„+d„ c„+d 

dnLd„ 



jl=C„ + l j2=C„ + l 



E E -^(^ii+Tl-'^j2+r2) 

1"!= — id„ T2=~Ld^ 



Denote the first, second and third terms of the last equality by co{n), ci{n) and C2{n), 
respectively. For the term ci(n), we have ci{n) = zi{n) + Z2{n) + 23(71.), where 



dnLd„ 
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= ^ E ^(^nx^^) EE- E 

" 0<ji-j2<2La^ Ti=-La„ \-r2=j2-ii-id„ -r2=i2-ii+id„+l/ 

X g~i('^i(ji+'^i)-^U'i-'^2(jl+-r2)+W2j2) 

-, -f'tin /j2-jl+Ld„ j2-jl~Ld„~l\ 

^sH^^ E ^(^..^.^) E E - E 

" 0<32~jl<'2Ld„ ri=-Ld„ \r2=Ld„+l T2=-Ld„ / 

X Q~K^i-Ul+Tl)-l^lil-V2{jl+T2)+'^2j2) 

Using Lemma A.l(i) and similar steps as for the term di(n), it can be proven that zi{n) 
tends to zero. For the term Z2{n), we have 

E E E + E 

0<il-j2<2Ld„ Tl=-id„ \T2=j2-jl-id„ T2 = ^2 ^ jl +i d„ + 1/ 

xa^/(2+^)(j,_j,)a^(2+5)(|ri-r2|) 

0<ji-j2<2Ld„ 

In the same way, we may prove that 2:3(71) 0. This means that ci{n) — > 0. Using Lemma 
A.l(i), inequahty {Hl^^ (^2) - i?Ld,. (n)| < W\T2-Ti\/Ld„ < W^(|t2 + (ja - ji)| + 1^2 - 
Ji|)/id„ and similar steps as for the term di{n), it can be proven that C2(n) tends to 
zero. This means that the term do{n) has the same limit as co{n). Now, using Lemmas 
A. 5 and A. 6 for the term Co(n), we get 

/I c„+d„ c„+d„ 

-1 ■ II II 

_ Cji-\-dn Cn+dn 

+ E E S(ji,j2-.?i)e-'(--^^"^+"^^'^)e„ (1.1,^.2) (31) 
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{2nY / w\x)AxP{vi,V2)P{^i.u:2)+o{l) + yn. 



For the term y„, we have 



'n\<en{vuV2)— J2 E 8AV/(2+^)(|ji-j2|)<g„(i^i,^^2)4/i7t^0. 



jl=C„ + l j2=Cn + l 



Hence, S2(n-) {'^t^) pP{vi,V2)P{'^ii^2)- FoUowmg the same steps, we get that 33(71) — >• 
(27T)^pP(i^i, 27T— a;2)P(i'2, 27T— cji). This completes the proof. □ 

Proof of Theorem 3.2. Let us consider the fohowing decomposition for the estimator 



+ ^djLZ{E{G'ii\v,u:)) - P{v,u:)) 



where S^'^iiy.oj) = ^%jLZiG';^''i^,u^)~ EiG-^^{i^,io))), e'^^iiy,uj) = ^djLZ{E{G'i;''{v, 
ui)) — P{v,uj)). We win now spht the proof into two steps. In the first step, we will show 
that the deterministic term e'^'^{i',uj) tends to zero for n — )- 00. In the second step, we 
will show that 



ReiS^„^''{iy,Lo)) 
Im(5;5^^(i^,w)) 



(32) 



Step 1. Without loss of generality, we may assume that ui <v. Changing variables and 
using, sequentially, (3), (5), (4), (A3) and assumption (ii) of our theorem, we then obtain 



\e'il\v,u:)\^ ^djLZ\E{G''^''{v,u)) ^ P{v,u)\ 

2^ E J2 HCn + l<J+T<Cn + dn}B{j,T)HL,jT) 



j = C„ + l T = -Ld„ 



< 



TT J2 B(j,r)ifi,Jr)e-'''-e-'(— )^-P(^.,a.) 



2nd, 



c„+d„ La 



Ld^ 2nd., 



i=c„+l T=-La„ 
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lO- + T<c„ + l})8AV/(2+^)(|r|) 



< 



^ y < 



4A2 



2nd 



V 



E 

j=c„+l \£K^\{u-ui} 



< 



E + E ]a{v-oj,T)HL,M^-"'^-n^^^) 



Ld„ 2ndn 



E E 



^ a(A,r)e'(^-(''-"))-'" 

J=c„ + 1 



-o(l) 



^Jr^f^ E 8AV/(2+*-)(|r|) 



+ ^ E E |a(A,r)coscc((A-(^-c.))/2)|)+o(l) 



< 



1 



5/(r+2+5)/ 



id 



/— - E E |a(A,r)cosec((A-(j.-^))/2)|+o(l) 



< 



8A^ / dn 

719'' 



1 / 1 



27T V dn \ id„ 



^ Z,(l/-W) +0(1) 



< 



8A2 



A' + ^ J ^:^o(i) + 0(1) = o(i)4i-'=(i+2,.))/2 + 0(1) 



nd'- Y 27T V dn 

0(l)d;;((l-'=)/(2K)-r) _^ ^ 
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where 1{-B} is an indicator function of the event B. This completes the proof of step 1. 
Step 2. In this step, we use Theorem 3.1 and Lemma A. 3 to show (32). Note that 



where cj) — i?„j and Ij{h',uj) — Inj are defined via 

L. 



j + T< dn}Zj+c„ (r) cos(i/r + {ly - uj){j + c„)), 

In,jiv,uj) = — ^ iJLd„ < j + t < dn}Zj+c„iT)sm{-iyT - {ly - Uj){j + Cn)) 

and Zj{T) — XjXj+r — B{j,T). Wc show that for triangular array {{Rn,t, In.t) : 1 < i < 
dn}, the assumptions of Theorem A. 3 hold. Note that by the Minkowski inequality, 
Lemma A.l(i) and, finally, by the Holder inequality, we have 

\\Rn.j{'^,^)\\2+S 



< 



-j= ^ iJi^^ (t)1{1 <j + T < d„}Xj+c„Xj+c„+r COs(i^T + (l^ - + C„)) 



2+5 



8A2 



<\\x 



j+c„ 116+35 



7= E ^L.„(r)l{l<j + r<d„}X,+,„+, 



X C0S(!^T -^{V - Uj){j + C„)) 



lOA^/v 



3+35/2 



< 



A 



E -ffLd„ (■^)1{1 < + T < d„}Xj+c„+r C0S(:^T Uj){j + C„)) 



3+35/2 



ti(n) 



leA^x. 



In the next step, we use Lemma A. 2 to estimate the term ti{n). Let Z = 3 + |(5 and note 
that 1 + 5 < 6 + 36, which means that assumption (i) of Lemma A. 2 holds. Assumption (ii) 
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of Lemma A. 2 follows from assumptfon (iii) of our theorem. Therefore, using Lemma A. 2 
(similarly as for /„.j(i/, w)), we get 

\\Rn,j{v.,Uj)\\2+S 

< A{K^j max{Q(3 + 35/2, S, -Ld„ - 1, 2id„ + 1), 

< AA'^f +'^/^'*')(max{(2i,„ + l)A^+i^/^)\ ((2L,„ + i)a2)(3+(3/2)^)/2|)1/(3+(3/2)^)/^ 

+ 16A2a: 



<A2(2A';,f+(3/2)*') + 16i^), 

which means that assumption (i) of Lemma A. 3 holds. Condition (ii) of Lemma A. 3 
follows from Theorem 3.1 by noting that 

coy{Re{S'/{v,uj)),Re{S'/{u,uj))) 



coy{Rb{S'/{v,uj))MS';^\v,u:))) 
d. 



d 



cov{G'/{j^,uj) - GT{i^,io),G'/{i^,Lj) - GT{i^,uj)). 



Finally, putting hn = 2Ld„ and <j(fc) = ax^k), and taking into consideration assumption 
(iii) of our theorem, we get that condition (iii) of Lemma A. 3 holds, which means that 
(32) holds, where T,{v,u}) can be obtained by the last three equations and Theorem 3.1. 
The calculation of the matrix E(i^, w) is too technical to be presented here. This completes 
the proof. □ 

Proof of Theorem 4.1. By Politis et al. [26], Theorem 4.2.1, it is sufficient to prove 
that there exists a continuous distribution J such that: 

d 



(i) y^(|G„(i.,w)|-|P(i^,L.)|)^ J; 

(ii) for any sequence of positive integers {ti,} = {tb{n)} such that b ^ b{n) — > oo, 
6/n — >• as n — >■ oo, we have Jft^ix) — > J(x), where J^t^ix) = P{y^b/ Lh{\Gl^^^-''{i',uj)\ — 
\P{v,uj)\) < x) and J{x) is a distribution function at the point x for the distribution J. 
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This follows immediately from Corollary 3.2 by setting c,i = ff,(,i) and d„ = b{n). This 
completes the proof. □ 

Proof of Theorem 4.2. This proof is analogous to the proof of Theorem 4.1. The only 
difference is that we use Corollary 3.3 instead of Corollary 3.2. 

□ 
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